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ABSTRACT 

We  present  Nexus  -  a  robust  and  scalable  middleware  for  decentralized  service-oriented  information 
fusion.  As  a  project  in  the  UK  Ministry’  of  Defence  Defence  Technology >  Centre,  Nexus  is  driven  by  the 
goals  of  Network  Enabled  Capability’  (NEC).  It  provides  support  for  discovering,  structuring  and  fusing 
information  -  key  operations  enabling  the  NEC  vision.  It  is  built  on  top  of  three  key  concepts  -  service- 
oriented  computing  based  on  web  sendees,  a  peer-to-peer  architecture  and  goal-oriented  automatic 
service  composition.  Combining  these  three  concepts,  Nexus  delivers  agile  information  fusion  capability > 
via  a  loosely  collaborating  set  of  information  and  fusion  sendees  deployed  in  the  service  network. 
Although  no  strict  restrictions  are  imposed,  the  fusion  sendees  are  supposed  to  provide  a  higher-level 
fusion  capability >  on  the  level  2  and  3  of  the  JDL  data  fusion  hierarchy  [12].  Implementation  of  peer-to- 
peer  sendee  oriented  information  fusion  based  on  JXTA  and  web  sendees  is  described,  together  with  a 
demonstration  application  exploiting  these  fusion  capabilities  to  support  an  emergency  response  scenario. 

INTRODUCTION 

The  Network  Enabled  Capability  (NEC)  vision  [1]  pursued  by  the  UK  Ministry  of  Defence  places  a  great 
emphasis  on  efficient  sharing  and  exploitation  of  information.  Two  out  of  nine  NEC  themes  are  directly 
related  to  information  fusion:  full  information  accessibility  and  shared  understanding.  The  network  of 
networks  connecting  thousands  of  assets  distributed  across  a  wide  range  of  environments  is  the  core 
concept  of  the  vision.  This  network  is  supposed  to  assist  in  finding,  structuring,  aggregating  and 
presenting  the  information  required  for  decision  support  in  the  most  appropriate  form. 

The  highly  heterogeneous  and  volatile  nature  of  the  network  of  networks,  together  with  robustness 
and  agility  requirements  stressed  throughout  the  NEC  vision,  asks  for  novel  approaches  to  information 
fusion.  In  order  to  meet  these  requirements,  we  propose  a  decentralized  information  fusion  architecture 
based  on  service-oriented  computing  [6]  and  peer-to-peer  paradigms  [8].  The  combination  of  both 
paradigms  offers  several  distinctive  advantages  over  more  traditional  fusion  architecture  relying  on  fixed, 
pre-specified  processes,  often  carried  out  by  monolithic,  isolated  systems.  These  advantages  are  further 
amplified  if  semantic  service  annotation  and  automated  service  composition  tools  are  used.  Used  together, 
these  technologies  provide  for  agile  information  fusion  capable  of  maximally  exploiting  all  available 
information  resources  while  rapidly  adapting  to  specific  client’s  requests  as  well  as  to  potential  service  or 
infrastructure  failure. 

The  paper  proceeds  as  follows.  In  Section  2,  we  describe  the  decentralized  service-oriented 
approach  to  information  fusion  and  its  key  components.  In  Section  3,  we  present  Nexus,  a  prototype 
middleware  supporting  service-oriented  service  fusion.  Section  4  discusses  advantages  and  disadvantages 
of  the  approach  and  explains  some  design  decisions  behind  Nexus  implementation.  Section  5  briefly 
describes  an  Emergency  response  application  built  using  Nexus,  and  Section  6  concludes  the  paper. 
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ORGANIZATION 


DECENTRALIZED  SERVICE-ORIENTED  INFORMATION  FUSION 

Rather  than  an  entirely  new  concept,  decentralized  service-oriented  information  fusion  is  an  application  of 
existing  concepts  to  a  field  where  they  have  not  yet  been  widely  applied.  The  constituent  concepts  of  the 
approach  are  service-oriented  computing1,  automated  service  composition  and  a  peer-to-peer  architecture. 
Studied  extensively  in  themselves,  little  effort  has  been  spent  on  bringing  the  technologies  together 
although  their  combination  offers  some  distinctive  advantages  for  information  fusion  in  highly  volatile 
environments. 

Service  Oriented  Computing 

Essentially,  each  information  fusion  process  involves  two  fundamental  elements:  (1)  information  to  be 
fused,  and  (2)  operations  applied  to  the  information  to  produce  new,  usually  higher-level,  output 
information.  The  main  idea  of  service-oriented  computing  is  to  decompose  information  processing 
workflows  into  elementary  building  blocks,  and  encapsulate  these  blocks  as  independent,  reusable  service 
components  with  a  standard  interface.  Such  components  can  be  arranged  into  desired  workflows  on  the 
fly,  based  on  operational  needs  and  service  availability.  The  outcome  is  significantly  increased  dynamism 
of  resulting  applications,  i.e.  the  key  advantage  of  service-oriented  computing. 

Specifically  in  information  fusion  workflows,  we  can  distinguish  two  main  types  of  services: 

•  Information  source  services  are  sources  of  primary  data  for  the  fusion.  Examples  of  source 
services  include  reference  databases,  image  repositories,  GIS  systems  or  even  the  world-wide 
web. 

•  Information  fusion  services  perform  the  actual  fusion  on  the  data  obtained  from  information 
source  services  or  fusion  services  on  a  lower  level  of  the  fusion  hierarchy 

In  the  perspective  of  service  oriented  computing,  fusion  processes  can  be  viewed  as  workflows  composed 
of  these  two  types  of  services.  These  workflows  can  be  composed  either  manually  by  a  human  expert,  or 
automatically  by  semantic  service  composition  tools.  We  discuss  differences  between  both  types  of 
composition  in  Section  3. 

Automated  Service  Composition 

Although  the  standard  service-oriented  computing  concept  provides  tools  to  create,  publish  and  consume 
toolboxes  of  reusable  services,  the  composition  of  service  workflows  is  still  done  by  a  human  expert. 
Semantic  service  composition  and  semantic  web  services  [11]  bring  service-oriented  computing  paradigm 
further.  By  introducing  tools  for  machine -understandable  semantic  annotation  of  services  and  reasoning 
about  these  annotations,  they  allow  for  automated  composition  of  service  workflows  by  means  of  goal- 
oriented  planning  agents. 

Peer-to-Peer  Architectures 

Existing  service-oriented  architectures  are  to  a  large  extent  centralized,  often  relying  on  the  existence  of 
one  or  more  servers  hosting  service  directories  (such  as  UDDI  repositories  in  case  of  web  services). 
Similarly,  services  themselves  are  normally  hosted  only  on  a  limited  number  of  servers  with  a 
significantly  larger  number  of  clients  consuming  them. 

In  relatively  stable  environments,  the  centralized,  client-server  architecture  has  some  advantages. 
These  include  higher  efficiency  thanks  to  minimum  redundancy,  easily  maintained  consistency,  or  easier 
control.  However,  with  its  single  points  of  failure,  the  centralized  architecture  is  also  much  more  fragile, 
and  can  suffer  from  significant  scalability  problems.  In  highly  volatile  and  heterogeneous  military 
environments,  where  robustness  and  resilience  are  critical  requirements,  a  different  approach  is  needed. 

Peer-to-peer  computing  presents  an  opposite  model  to  client-server  architectures.  In  a  peer-to-peer 
system,  every  node  acts  both  as  a  client  and  a  server;  there  are  no  critical  central  nodes  and  no  central 


Service-oriented  computing  is  sometimes  identified  with  web  services,  although  web-services  are  in  fact  only  one  possible 
example  of  service-oriented  architecture 
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control  of  the  network.  Because  of  their  decentralized  nature,  peer-to-peer  systems  are  inherently  more 
robust  and  resilient  to  failure  and  attacks.  In  addition,  the  fact  that  all  nodes  host  processing  capabilities 
allows  for  evenly  distributed  resource  utilization,  removing  bottlenecks  traditionally  occurring  on  the 
server  side.  Finally,  in  the  case  of  information  fusion,  the  peer-to-peer  approach  allows  processing  of  data 
closer  to  its  origin,  thus  significantly  reducing  bandwidth  required  for  data  transmission.  For  these 
reasons,  the  decentralized  peer-to-peer  architecture  is  the  architecture  of  choice  for  the  implementation  of 
the  NEC  concept  [13]. 

NEXUS  MIDDLEWARE 

Nexus  is  a  middleware  for  service-oriented  information  fusion  developed  in  BT’s  Pervasive  ICT  research 
centre.  It  brings  all  the  three  key  concepts,  i.e.  service-oriented  computing,  automated  service  workflow 
composition  and  peer-to-peer  architecture,  into  a  prototype  implementation.  Given  a  fusion  task,  Nexus 
composes  a  tailored  fusion  workflow,  executes  the  workflow  and  returns  the  fused  information  to  the 
client. 

Nexus  middleware  consists  of  the  following  key  elements: 

•  expressive  description  framework  for  service  annotation  and  fusion  task  specification 

•  peer-to-peer  service  discovery  tier 

•  service  composition  and  execution  tier 

In  addition  the  above  three  elements,  the  following  two  tiers,  although  not  directly  part  of  it,  interact 
closely  with  Nexus: 

•  service  tier  consisting  of  services  deployed  in  the  service  network 

•  application  tier  consisting  of  client  application  of  the  Nexus  middleware 
We  now  describe  each  of  the  elements  in  a  more  detail. 


Service  tier 


Composition  tier 


Peer-to-peer 
discovery  tier 
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Expressive  Description  Framework 

The  description  framework  provides  tools  for  annotation  of  service  capabilities  and  the  specification  of 
fusion  tasks.  Both  the  discovery  and  the  composition  components  of  the  middleware  rely  on  the 
framework.  As  the  need  for  expressive  annotation  is  crucial  to  semantic  web  and  semantic  web  service 
technologies,  several  frameworks  have  already  emerged  to  address  it. 

OWL-S  (previously  DAML-S)  [10]  is  currently  the  most  popular  language  for  semantic  service 
annotation,  partly  because  it  builds  on  WSDL  format  and  extends  it  with  semantic  concepts.  Despite  its 
popularity,  it  has  been  shown  to  suffer  from  several  critical  deficiencies  which  make  its  application  in 
practice  highly  problematic  [2],  Web  Service  Modelling  Ontology  (WSMO)  [3],  a  more  recent  initiative, 
attempts  to  remedy  some  of  the  deficiencies.  It  is  still,  however,  work  in  progress  and  only  a  very 
preliminary  implementation  of  supporting  tools  is  available. 

For  these  reasons,  Nexus  currently  uses  a  simpler  custom  XML-based  annotation  language  based 
on  service  type  hierarchies. 

Service  Discovery  Tier 

This  tier  provides  service  registration,  look-up  and  matchmaking  capability.  It  is  based  on  the  peer-to-peer 
network  paradigm,  which  provides  an  inherently  robust  and  scalable  architecture.  The  robustness  of  the 
discovery  process  can  be  further  increased  by  the  application  of  a  custom  resilient  peer-to-peer  routing 
algorithm  we  have  developed  [4].  The  core  implementation  is  currently  based  on  the  JXTA  [5]  peer-to- 
peer  protocol  but  other  alternatives  that  can  support  higher-level  semantic  service  discovery  and 
matchmaking  are  being  explored. 

Service  Composition  and  Execution  Tier 

This  is  the  higher-level  tier  of  Nexus,  and  the  tier  with  which  applications  normally  interface  most  often 
(although  they  can  still  connect  to  the  discovery  tier  directly).  It  provides  agile  service  composition  and 
execution  capabilities.  In  order  to  satisfy  a  wide  range  of  usage  scenarios,  it  supports  two  types  of  fusion 
processes  involving  a  different  level  of  human  interaction  and  autonomy  of  the  fusion  process. 

Data-Driven  Fusion 

In  this  case,  available  data  sources  are  the  primary  driver  of  the  fusion  process.  The  data-driven  approach 
is  particularly  suitable  for  explorative  tasks  where  the  outcome  of  the  fusion  is  not  clearly  specified  but 
where  some  initial  data  is  available.  By  applying  fusion  operations  to  this  data  and  by  combining  them 
with  other  information  sources,  a  more  complete  information  picture  is  incrementally  constructed.  In 
principle,  explorative,  data-driven  fusion  involves  significant  user  interaction  -  the  user  chooses  from 
available  services  and  decides  when  they  should  be  applied  to  improve  the  information  picture  gathered  so 
far.  As  the  number  of  applicable  services  can  be  very  high,  Nexus  employs  several  fusion  assistant  agents 
(providing  service  filtering,  prioritization  and  assisted  matching)  in  order  to  prevent  user  overload. 

Goal-Driven  Fusion 

Goal-driven  fusion,  on  the  other  hand,  is  advantageous  when  the  desired  outcome  of  the  information 
fusion  is  well  specified.  This  includes  situations  in  which  the  fusion  supplies  information  for  established 
decision  support  procedures.  In  this  case,  fusion  is  initiated  by  submitting  a  fusion  task  specifying 
information  to  be  obtained  from  the  service  network.  Example  of  a  fusion  task  is  “assess  threat  potentially 
originating  from  a  specified  area”;  the  execution  of  such  a  task  involves  fusing  information  from 
reconnaissance  services,  reference  databases,  GIS,  weather  services  etc. 

Goal-oriented  planning  techniques  are  used  to  process  the  task  and  compose  a  service  workflow 
that  delivers  the  desired  information  as  its  output.  The  composition  process  relies  heavily  on  the  service 
annotation  framework  to  work  out  the  dependencies  between  services  and  the  optimum  way  to  arrange 
them  into  a  fusion  workflow.  The  workflow  is  subsequently  executed  under  the  supervision  of  the 
workflow  execution  agent.  Should  an  exception  occur  during  the  workflow  execution,  the  execution  agent 
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carries  on  a  number  of  recovery  strategies  (such  as  service  substitution  and  workflow  replanning).  The  fact 
that  the  fusion  workflow  for  a  task  is  constructed  on  the  fly  based  on  currently  available  services  and  the 
managed  workflow  execution,  accounts  for  the  robustness  of  the  Nexus  composition  tier,  and  the  agility  of 
the  overall  fusion  process.  Fusion  workflow  composition  involves  a  goal-oriented  planning  activity. 
Several  goal-oriented  planning  techniques  for  service  composition  are  being  investigated,  one  of  them 
being  the  Kreno  service  composition  toolkit  [9]  developed  in  the  BT  Intelligent  Systems  research  centre. 

Service  Tier 

This  tier  contains  the  services  deployed  in  the  service  network.  In  the  case  of  Nexus,  platform  independent 
web  services  as  well  as  light-weight  socket-based  services  are  supported. 

Application  Tier 

This  tier  contains  applications  built  using  Nexus.  A  user  normally  does  not  interact  with  the  Nexus 
middleware  directly  but  through  a  set  of  domain-specific  applications.  Generally,  such  applications  help 
the  user  to  create  and  refine  fusion  tasks  as  well  as  to  interpret  information  obtained  by  executing  the  tasks 
using  the  Nexus  middleware. 

DISCUSSION 

Advantages  of  Peer-to-Peer  Service-Oriented  Information  Fusion 

We  can  summarize  advantages  of  the  proposed  approach  as  follows: 

•  robustness  ensured  by  the  use  of  peer-to-peer  infrastructure  without  vulnerable  central  elements. 

•  scalability  thanks  to  peer-to-peer  architecture;  both  the  middleware  components  and  the  services 
in  the  service  tier  are  distributed  across  the  network,  preventing  creation  of  possibly  overloaded 
central  elements 

•  agility  underpinned  by  the  robust  service  discovery  and  the  dynamic  service  composition;  this 
way,  the  middleware  makes  the  best  use  of  available  services  and  adapts  rapidly  to  potential 
service  failures 

•  modularity  thanks  to  loosely  connected  architecture  of  explicitly  published,  decoupled  fusion 
capabilities 

•  extensibility  thanks  to  the  unified  interface  of  the  components  in  the  service  network;  new  fusion 
functionality  can  be  added  by  deploying  and  publishing  an  information  or  fusion  service  into  the 
service  network 

The  three  underpinning  technologies  described  in  Section  2  contribute  differently  to  the  above  given 
properties;  to  get  a  better  understanding  of  their  individual  contribution,  see  Table  1. 
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Service-oriented 

computing 

Peer-to-peer 

architecture 

Automated  service 
composition 

Agility 

• 

• 

Extensibility 

• 

• 

Modularity 

• 

Robustness 

• 

• 

Scalability 

• 

• 

Table  1:  Contribution  of  key  technologies  within  the  Nexus  middleware  to  its  overall  properties 
Design  Notes 

The  guiding  principle  of  the  Nexus  design  is  to  use  standard  technologies  where  they  are  available  (e.g. 
web  services,  and  peer-to-peer  discovery),  with  simplified  custom  techniques  where  such 
standards/technologies  have  not  been  yet  established;  specifically  semantic  service  annotation  and 
automated  service  composition.  Because  of  the  early  nature  of  the  prototype  and  the  experimental  status  of 
technologies  involved,  implemented  capabilities  are  necessarily  limited.  Despite  these  limitations  the 
Nexus  prototype  provided  validation  of  the  initial  design  and  helped  to  better  understand  potential 
capabilities  offered  by  service  oriented  information  fusion.  As  the  development  in  individual  areas 
progresses,  the  components  are  continuously  updated. 


APPLICATIONS 

Although  the  military  is  a  primary  application  domain,  Nexus  can  also  bring  benefits  in  civil  applications. 
This  is  especially  true  for  complex,  fast-changing  scenarios  with  a  large  number  of  information  sources 
where  rapid  and  effective  response  is  required.  We  have  therefore  developed  and  implemented  an 
“Emergency  response”  scenario  (see  Figure  2),  which  demonstrates  how  Nexus  can  support  explorative 
information  fusion  for  emergency  response  organisations. 

In  the  scenario,  an  emergency  response  operator  is  equipped  with  a  Nexus-based  application  operating 
over  a  network  of  information  and  emergency  response  services.  The  application  follows  the  data-driven 
fusion  approach.  It  allows  a  dispatcher  to  discover,  access  and  fuse  services  in  order  to  obtain  an  up-to- 
date  situational  picture  about  an  emergency  and  resources  available  to  address  it.  The  discovered  services 
are  automatically  ranked  according  to  several  criteria.  Mutual  relevancy  between  an  emergency  event  and 
services  is  calculated  based  on  the  geographical  proximity  and  the  type  of  emergency.  Furthermore,  utility 
of  each  service  is  evaluated  in  terms  of  how  much  its  application  would  improve  the  situational  picture 
constructed. 

Various  types  of  information  services  provided  with  a  standard  web-service  interface  are  used  in  the 
scenario.  CCTV  cameras,  widely  deployed  in  urban  areas  of  the  UK,  provide  a  rich  array  of  visual 
information  sources.  Together  with  emergency  call  records,  MMS  picture  messages,  and  car  crash  sensor 
information  feeds  (in  case  of  car  accidents),  they  are  used  to  provide  initial  information  regarding  the 
emergency.  Several  back-end  databases,  including  patient  electronic  health  records  and  car  registration 
records,  are  also  integrated.  This  enables  an  operator  to  crosslink  data  from  sources  directly  related  to  an 
emergency  with  a  wider  information  background.  In  addition,  services  providing  real-time  information  on 
the  availability  of  emergency  response  resources  (such  as  ambulances  and  hospitals)  are  accessible 
through  the  network.  Based  on  such  information,  an  operator  can  efficiently  allocate  resources  required  to 
address  the  emergency. 
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Figure  2:  Emergency  response  application  built  using  Nexus  middleware 


Nexus 


CONCLUSIONS 


A  peer-to-peer  service  oriented  approach  to  information  fusion  addresses  the  need  for  robust,  agile  and 
task-oriented  information  fusion  in  the  highly  volatile  environments  of  future  military  scenarios.  Nexus  is 
an  experimental  middleware  for  decentralized,  peer-to-peer  service  oriented  information  fusion.  It 
supports  building  network-centric  fusion  applications  based  on  loosely  collaborating  sets  of  fusion 
services.  Nexus  consists  of  a  service  annotation  and  task  specification  framework,  peer-to-peer  service 
discovery  tier  based  on  JXTA  and  automated  service  workflow  composition  tier.  In  addition  to  the 
middleware  prototype,  an  example  end-user  “emergency  response  application  based  on  Nexus  has  been 
implemented.  Experience  gained  during  the  implementation  and  the  user  feedback  obtained  indicate  the 
viability  of  the  chosen  approach.  Currently,  we  are  examining  more  expressive  service  annotation 
frameworks  and  peer-to-peer  search  techniques,  and  we  will  incorporate  them  into  Nexus  as  soon  as  viable 
implementations  become  available. 
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Presentation  Outline 


•  Service-oriented  information  fusion 

•  Nexus  overview 

•  User-directed  fusion 

-  Emergency  response  demonstrator 

•  Goal-oriented  fusion 

-  Convoy  scenario  demonstrator 

•  Conclusion 
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Service-Oriented  Information  Fusion 


•  Marrying  service-oriented  computing  with  information 
fusion 

•  Network  perspective  on  information  fusion 

-  fusion  a  distributed  network  processed 

-  information  sources  and  fusion  operators  as  network 
services 
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Nexus  Overview 


•  Autonomous  middleware  for  service-oriented 
information  fusion  in  volatile  and  decentralised 
network  environments 


•  Network  enabled  capability  (NEC)  themes  addressed: 

-  full  information  accessibility 

-  shared  understanding 

•  Decentralised  service  discovery 

•  Just-in-time  fusion  process  composition 


Data  Information  Fusion  Defence  Technology  Centre 


Michal  Jakob  BT 


•  Enabling  information-driven  response  in  complex  and 
dynamic  environments 

-  Agility:  Maximum  exploitation  of  available  information 
resources 

-  Decreased  cognitive  burden  on  the  decision  maker: 

Off-load  to  autonomous  capabilities 

•  Interoperability:  exploiting  accepted  standards 

•  Resilience:  maintaining  operation  in  adversary 
conditions 
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•  New  generation  networks  are  increasingly  ad-hoc  and 
volatile 


•  Centralised  discovery  mechanisms  do  not  scale  and 
are  not  robust  enough 

•  Web  services  composition  technologies  unsuitable  for 
volatile  environments  and  information  fusion  tasks 


•  Integration  and  administration  of  information 
resources  is  labour-  and  expertise-intensive 
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Nexus  Architecture 
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Service  Network 
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Emergency  Response  Scenario 


•  Incremental  agent- 
assisted  service  fusion 


□  (MsiwXcImm  find 


•  Real-time  service 

discovery 

•  Service  availability 

monitoring 

•  Service  substitution 
case  of  failure 


in 
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Autonomous  Fusion 
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Nexus  Fusion  Framework 


•  Real-time  fusion  tree  composition 

•  Components: 

-  Job:  a  request  to  obtain  a  specific  information 

-  Interface:  a  capability  to  process  a  specific  type  of  jobs 

-  Service:  implements  1+  interface(s) 

-  Host:  hosts  1  +  service(s) 
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Fusion  Trees 


THREAT  ASSESMENT 
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Convoy  Scenario 
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•  Nexus 


-  Patented  novel  architecture  for  distributed  service 
composition  -  in  progress 


•  SCAN 

-  Novel  weighted  edge  neural  algorithm  for  P2P  networks 

-  Robust  service  discovery  mechanism 


•  DEIMOS 

-  Novel  design  for  data  security  +  interoperability  in  NEC 
networks 
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Future  Work 


•  Semantic-enabled  discovery 

-  a  more  expressive  description  framework 

•  More  self-organization  techniques 

-  adaptive  job  routing 

•  Integration  with  an  advanced  user  front-end 
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Conclusions 


•  Autonomous  middleware  for  network-oriented 
information  fusion 

-  Agile:  optimum  exploitation  of  available  resources 

-  Adaptive:  reacts  to  changes  in  service  availability 

-  Lightweight  while  flexible 

-  Robust:  P2P  +  adaptive  +  lightweight 

->  Better  situational  awareness  ->  better  decisions 


Reduced  costs  and  manpower 
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